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Abstract 

In this paper we investigate algorithmic randomness on more general spaces than 
the Cantor space, namely computable metric spaces. To do this, we first develop a 
unified framework allowing computations with probability measures. We show that 
any computable metric space with a computable probability measure is isomorphic 
to the Cantor space in a computable and measure-theoretic sense. We show that 
any computable metric space admits a universal uniform randomness test (without 
further assumption). 
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1 Introduction 



The theory of algorithmic randomness begins with the definition of individual 
random infinite sequence introduced in 1966 by Martin-L6f [1]. Since then, 
many efforts have contributed to the development of this theory which is now 
well established and intensively studied, yet restricted to the Cantor space. In 
order to carry out an extension of this theory to more general infinite objects 
as encountered in most mathematical models of physical random phenomena, 
a necessary step is to understand what means for a probability measure on a 
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general space to be computable (this is very simple expressed on the Cantor 
Space). Only then algorithmic randomness can be extended. 

The problem of computability of (Borel) probability measures over more gen- 
eral spaces has been investigated by several authors: by Edalat for compact 
spaces using domain-theory ([2]); by Weihrauch for the unit interval ([3]) and 
by Schroder for sequential topological spaces ([4]) both using representations; 
and by Gacs for computable metric spaces ([5]). Probability measures can be 
seen from different points of view and those works develop, each in its own 
framework, the corresponding computability notions. Mainly, Borel probabil- 
ity measures can be regarded as points of a metric space, as valuations on open 
sets or as integration operators. We express the computability counterparts of 
these different views in a unified framework, and show them to be equivalent. 

Extensions of the algorithmic theory of randomness to general spaces have 
previously been proposed: on effective topological spaces by Hertling and 
Weihrauch (see [6], [7]) and on computable metric spaces by Gacs (see [5]), 
both of them generalizing the notion of randomness tests and investigating 
the problem of the existence of a universal test. In [7], to prove the existence 
of such a test, ad hoc computability conditions on the measure are required, 
which a posteriori turn out to be incompatible with the notion of computable 
measure. The second one ([5]), carrying the extension of Levin's theory of ran- 
domness, considers uniform tests which are tests parametrized by measures. 
A computability condition on the basis of ideal balls (namely, recognizable 
Boolean inclusions) is needed to prove the existence of a universal uniform 
test. 

In this article, working in computable metric spaces with any probability mea- 
sure, we consider both uniform and non-uniform tests and prove the following 
points: 

• uniformity and non-uniformity do not essentially differ, 

• the existence of a universal test is assured without any further condition. 

Another issue addressed in [5] is the characterization of randomness in terms of 
Kolmogorov Complexity (a central result in Cantor Space). There, this char- 
acterization is proved to hold (for a compact computable metric space X with 
a computable measure) under the assumption that there exists a computable 
injective encoding of a full-measure subset of X into binary sequences. In the 
real line for example, the base- two numeral system (or binary expansion) con- 
stitutes such encoding for the Lebesgue measure. This fact was already been 
(implicitly) used in the definition of random reals (reals with a random binary 
expansion, w.r.t the uniform measure). 

We introduce, for computable metric spaces with a computable measure, a 
notion of binary representation generalizing the base-two numeral system of 
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the reals, and prove that: 



• such a binary representation always exists, 

• a point is random if and only if it has a unique binary expansion, which is 
random. 



Moreover, our notion of binary representation allows to identify any com- 
putable probability space with the Cantor space (in a computable-measure- 
theoretic sense). It provides a tool to directly transfer elements of algorith- 
mic randomness theory from the Cantor space to any computable probabil- 
ity space. In particular, the characterization of randomness in terms of Kol- 
mogorov complexity, even in a non-compact space, is a direct consequence of 
this. 



The way we handle computability on continuous spaces is largely inspired 
by representation theory. However, the main goal of that theory is to study, 
in general topological spaces, the way computability notions depend on the 
chosen representation. Since we focus only on Computable Metric Spaces (see 
[8] for instance) and Enumerative Lattices (introduced in setion 2.2) we shall 
consider only one canonical representation for each set, so we do not use 
representation theory in its general setting. 



Our study of measures and randomness, although restricted to computable 
metric spaces, involves computability notions on various sets which do not 
have natural metric structures. Fortunately, all these sets become enumerative 
lattices in a very natural way and the canonical representation provides in each 
case the right computability notions. 



In section 2, we develop a language intended to express computability con- 
cepts, statements and proofs in a rigorous but still (we hope) transparent way. 
The structure of computable metric space is then recalled. In section 3, we 
introduce the notion of enumerative lattices and present two important ex- 
amples to be used in the paper. Section 4 is devoted to the detailed study of 
computability on the set of probability measures. In section 5 we define the 
notion of binary representation on any computable metric space with a com- 
putable measure and show how to construct such a representation. In section 
6 we apply all this machinery to algorithmic randomness. 
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2 Basic definitions 



2. 1 Recursive functions. 

The starting point of recursion theory was the mathematization of the intu- 
itive notion of function computable by an effective procedure or algorithm. The 
different systems and computation models formalizing mechanical procedures 
on natural numbers or symbols have turned out to coincide, and therefore have 
given rise to a robust mathematical notion which grasps (this is Church- Turing 
thesis) what means for a (partial) function if : N — > N to be algorithmic, and 
which can be made precise using any one of the numerous formalisms pro- 
posed. Following the usual denomination, we call such a function a (partial) 
recursive function. To show that a function ip : N — > N is recursive, we will 
exhibit an algorithm A which on input n halts and outputs <p(ri) when it is 
defined, runs forever otherwise. 

In the same vein, a robust notion of (partial) recursive function F : N N — > N N 
can be characterized by different formal definitions: 

Via domain theory (see [9]). This approach takes the notion of recursive 
function as primitive, which avoids the definition of a new computation 
model. A partial function F : N N — > N N is recursive if there is a recursive 
function F' : W — > N* which is monotone for the prefix ordering, such that 
for all a G dom(F), F(a) is the infinite sequence obtained at the limit by 
computing F' on the finite prefixes of a (precisely, the Baire space can be 
embedded into the set of finite and infinite sequences of integers ordered by 
the prefix relation, which is an u- algebraic domain). 

Via oracle Turing machines (used by Ko and Friedman, see [10], [11]). 
An oracle Turing machine Ai^ is a Turing machine which works with a 
sequence a G N N provided as oracle and is allowed to read elements a n of 
the oracle sequence. On an input n G N, it may stop and output a natural 
number, interpreted as F(a) n . 

Via type-two Turing machines (defined by Weihrauch, see [12]). Expressed 
differently, it is essentially the same computation model (it works on sym- 
bols instead of integers). 

Again, to show that a function F : N N — * N N is recursive, we will exhibit an 
algorithm A which given a G N N as oracle and n as input, halts and outputs 
F(a) n . The algorithm together with a in the oracle is denoted A^. 

A sequence a G N N is recursive if the function n i— > o~ n is recursive. Given 
a family (ai)^ of recursive sequences, o~i is recursive uniformly in i if 
the function (i, n) i— > is recursive, where (, ) denotes some computable 
bijection between tuples and natural numbers. 
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2.2 Representations and constructivity 

A representation on a set X is a surjective (partial) function p : N N — > X. Let 
X and F be sets with fixed representations px and py. 

Definition 2.2.1 (Constructivity notions) 

(1) An element x G X is constructive if there is a recursive sequence a 
such that px(o~) = x. 

(2) The elements of a sequence (xi)j g N ore uniformly constructive if there 
is a family (crj)j of uniformly recursive sequences such that px{.°~i) = x i 
for all i. 

(3) A function f :C X — > Y is constructive on D C X if there exists a re- 
cursive function F : N N — > N N such that the following diagram commutes 
on p x \D): 

px I I Py {that is, f o Px = p Y o F on p x 1 {D)) 
X -U Y 

We say that y is x- constructive if there is a function / :C X — > F con- 
structive on {x} with /(x) = y. If x is constructive, x-constructivity and 
constructivity are equivalent. Note that two sequences of natural numbers can 
be merged into a single one, so the product X x F of two represented sets 
has a canonical representation. In particular, it makes sense to speak about 
(x, ^-constructive elements. 

2.3 Objects 

There is a canonical way of defining a representation on a set X when 1) some 
collection of elementary objects of X can be encoded into natural numbers 
and 2) an element of X can be described by a sequence of these elementary 
objects. Once encoded into natural numbers, the elementary objects inherit 
their finite character and may be output by algorithms. Let us make it precise: 

Definition 2.3.1 A numbered set O is a countable set together with a total 
surjection u : N — > O called the numbering. We write o n for u(n). 

A numbered set O and a (partial) surjection 5 : O n — > X induce canonically 
a representation p = 5 o i> . At least in this paper, all representations will be 
obtained in this way. A sequence of finite objects which is mapped by 5 to x 
is called a description of x. 
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An algorithm may then be seen as outputting objects: 

Given a numbered set O, we say that an algorithm (plain or with oracle) 
enumerates a sequence of objects (o ni ) ie ^ if on input i it outputs n^. Given 
a representation (O, 5) on a set X, an algorithm enumerating a description of 
x E X is said to describe x. 

An algorithm may also take objects as inputs, with a restriction: 

Definition 2.3.2 An algorithm A is said to be extensional on an element 
x E X if for alia such that px(c) = x, A^ describes the same element y E Y. 

We then say that A re-describes y or that A^ describes y. 

The constructivity notions of definition 2.2.1 can then be expressed using this 
language, which will be used throughout this paper. 

(1) An element x E X is constructive if there is an algorithm describing x, 

(2) The elements of a sequence (xi)^ are uniformly constructive if there is 
an algorithm A such that A((i, .)) describes x iy 

(3) A function / :C X — > Y is constructive on D C X if there exists an 
algorithm which x-describes f(x) for all x E D. 

A ^-constructive element y may be x-described by an algorithm which is 
extensional only on x, and thus induce a function which is defined only at x. 

2.4 Computable Metric Spaces 

Definition 2.4.1 A computable metric space is a triple X = (X,d,S), 
where: 

• (X, d) is a separable complete metric space (polish metric space), 

• S = {si : i E N} is a countable dense subset of X, 

• The real numbers d(si,Sj) are all computable, uniformly in 

The elements of S are called the ideal points. The numbering v§ defined 
by fs(i) '■= s i makes S a numbered set. Without loss of generality, u s can 
be supposed to be injective: as d(si, Sj) > can be semi-decided, v s can be 
effectively transformed into an injective numbering. Then a sequence of ideal 
points can be uniquely identified with the sequence of their names. 

The numbered sets S and Q>o induce the numbered set of ideal balls B := 

{B(si,qj) : Si E S,qj E Q >0 }, the numbering being v B ((i,j)) := B{s i ,q j ). 
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We write Buj\ for i/s{{i,j)). The closed ball {x e X : d(s,x) < r} is de- 
noted B(s, q) and may not coincide with the closure of the open ball B(s, q) 
(typically, if the space has disconnection). 

We now recall some important examples of computable metric spaces: 
examples: 

(1) (E N ,d,S) where E is a finite alphabet, d{uj,uj') := 2- min { neN:w "^"> and 
S := {wOOO . . . : w e E*} where E* is the set of finite words on E and 
is some fixed symbol from E, 

(2) (R n , o?r™, Q n ) with the euclidean metric and the standard numbering of 

Q n , 

(3) The product (X x Y,d, Sx x Sy) of two computable metric spaces has 
a canonical computable metric space structure, with d((x, y), (x f , y')) = 
max{d x (x, x'), d Y (y, y')}. 

For further examples, like functions spaces C[0, 1] and LP for computable p > 1 
we refer to [Weihrauch]. A sequence (x n ) n( zfq of points is said to be a fast 
Cauchy sequence, or simply a fast sequence if d(x n ,x n+ i) < 2~ n for all n. 

Definition 2.4.2 On a computable metric space (X,d,S), the canonical rep- 
resentation is the Cauchy representation (S,5c) defined by 5c(~~s) = x for all 
fast sequence s of ideal points converging to x. 

Again, each set X with a computable metric structure (X, d, S) will be implic- 
itly represented using the Cauchy representation. Then canonical constructiv- 
ity notions derive directly from definition 2.2.1. It is usual to call a construc- 
tive element of X a computable point, and a constructive function between 
computable metric space, a computable function. Remark that the com- 
putable real numbers are the computable points of the computable metric 
space (R,d,Q). 

The choice of this representation is justified by the classical result: every com- 
putable function between computable metric spaces is continuous (on its do- 
main of computability). 

Proposition 2.4.1 The distance d : X x X ^ M. is a computable function. 

Proposition 2.4.2 For a point x e X, the following statements are equiva- 
lent: 

• x is a computable point, 

• all d(x, Si) are upper semi- computable uniformly in i, 

• d x :— d(x, .) : X — > R is a computable function. 



7 



Several metrics and effectivisations of a single set are possible, and induce 
in general different computability notions: two computable metric structures 
(s,S) and (d',S') are said to be effectively equivalent if id : (X,d,S) — > 
(X, d', S') is a computable homeomorphism (with computable inverse). In this 
case, all computability notions are preserved replacing one structure by the 
other (see [8] for details). 



3 Enumerative Lattices 

3. 1 Definition 

We introduce a simple structure using basic order theory, on which a natural 
representation can be defined. The underlying ideas are those from domain 
theory, but the framework is lighter and (hence) less powerful. Actually, it is 
sufficient for the main purpose: proposition 3.1.1. This will be applied in the 
last section on randomness. 

Definition 3.1.1 An enumerative lattice is a triple (X, <,V) where (X, < 
) is a complete lattice and V C X is a numbered set such that every element 
x of X is the supremum of some subset ofV. 

We then define Vi(x) := {p G V : p < x} (note that x = supVi(x)). Any 
element of X can be described by a sequence ~p of elements of V . Note that 
the least element _L need not belong to V: it can be described by the empty 
set, of which it is the supremum. 

Definition 3.1.2 The canonical representation on an enumerative lattice (X, < 
,V) is the induced by the partial surjection S<(p) = sup p (where the se- 
quence ~p may be empty). 

From here and beyond, each set X endowed with an enumerative structure 
(X, <,V) will be implicitly represented using the canonical representation. 
Hence, canonical constructivity notions derive directly from definition 2.2.1. 
Let us focus on an example: the identity function from X to X is computed 
by an algorithm outputting exactly what is provided by the oracle. Hence, 
when the oracle is empty, which describes _L, the algorithm runs forever and 
outputs nothing, which is a description of _L. 

examples: 

(1) (M, <,Q) with 1 = RU {— oo,+oo}: the constructive elements are the 
so-called lower semi- computable real numbers, 
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(2) (2 N , C, {finite sets}): the constructive elements are the r.e sets from clas- 
sical recursion theory, 

(3) ({±,T},<,{T}) with±<T. 

We recall that a real number x is computable if both x and — x are lower 
semi-computable. 

Here is the main interest of enumerative lattices: 

Proposition 3.1.1 Let (X,<,V) be an enumerative lattice. There is an enu- 
meration (xi)j € N of all the constructive elements of X such that Xi is construc- 
tive uniformly in i. 

proof: there is an enumeration p of the r.e subsets of N: for every r.e subset 
E of N, there is some % such that E = Ei := {tp((i, n)) : n G N}. Moreover, we 
can take <p such that whenever E^ ^ the function (p({i, ■)) : N — > N is total 
(this is a classical construction from recursion theory, see [13]). Then consider 
the associated algorithm A v = v-p o <p: for every constructive element x there 
is some i such that A v ((i, .)) : N — > V enumerates x (0 is an enumeration of 
J.). □ 

Remark 3.1.1 Observe that on every enumerative lattice the Scott topology 
can be defined: a Scott open set O is an upper subset (x^O,x<y^yEO) 
such that for each sequence p = (p ni )iem su °h that sup p G O, there is some 
k such that sup{p no , . . . ,p nk } £ O. 

If Y and Z have enumerative lattice structures, a function f : Y — > Z is 
said to be Scott-continuous if it is monotonic and commutes with suprema of 
increasing sequences (one can prove that f is Scott- continuous if and only if 
it is continuous for the Scott topologies on Y and Z) and is easy to see that 
a Scott- continuous function f : Y — > Z such that all /(sup{p ni , . . . ,p nk }) ar & 
constructive uniformly in (ni, . . . ,n k ), is in fact a constructive function. 



3.2 Functions from a computable metric space to an enumerative lattice 



Given a computable metric space (X, d, S) and an enumerative space (Y, <, V), 
we define the numbered set T of step functions from X to Y: 



f{i,3)( X ) 



Pj if x G Bi 
_L otherwise 



We then define C(X, Y) as the closure of T under pointwise suprema, with 
the pointwise ordering We have directly: 
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Proposition 3.2.1 (C(X, Y), J 7 ) is an enumerative lattice. 

example: the set M + = [0, +00) U {+00} has an enumerative lattice structure 
<, Q + ), which induces the enumerative lattice C(X, IR + ) of positive lower 
semi-continuous functions from X to R + . Its constructive elements are the 
positive lower semi- computable functions. 

We now show that the constructive elements of C(X, Y) are exactly the con- 
structive functions from X to Y. 

To each algorithm A we associate a constructive element of C(X, Y), enumerat- 
ing a sequence of step functions: enumerate all (n, i , . . . , i^) with d(sj ., s ij+1 ) < 
2-0+ 1 ) for all j < k (prefix of a super- fast sequence). Keep only those for which 
the computation of A^ 0, '" ,lk,0 ' 0, "^(n) h a its without trying to read beyond i k . 
For each one, the latter computation outputs some element pi. then output 
the step function fun where Bi = B(si k , 2~ k ). We denote by f A the supremum 
of the enumerated sequence of step functions. 

Lemma 3.2.1 For all x on which A is extensional, f A {x) is the element of 
Y described by A^ . 

proof: let y be the element described by A^. 

For all (n, i , . . . , i^) for which some f^j) is enumerated with x e Bi, there is a 
fast sequence converging to x starting with Sj , . . . , St k , for which A^ s ' (n) = 
Pj. Then y > pj = f{i,j)(x). Hence y > f A (x). 

There is a super-fast sequence ~~s converging to x: for all n, A^ s ^(n) stops 
and outputs some pj n , so there is some i n with x G Bi n such that f(i n ,j n ) is 
enumerated. Hence, y = sup n p jn = sup f( in , jn )(x) < f A (x). □ 

Proposition 3.2.2 The constructive elements ofC(X,Y) are exactly the (to- 
tal) constructive functions from X to Y . 

proof: the supremum of a r.e subset E of T is a total constructive function: 
semi-decide in dovetail x G B; t for all f^ G E, and enumerate pj each time a 
test stops. 

Given a total constructive function /, there is an algorithm A which on each 
x £ X is extensional and describes f(x), so / = f A . □ 

The proof even shows that the equivalence is constructive: the evaluation of 
any / : X — > Y on any x G X can be achieved by an algorithm having access 
to any description of / G C(X,Y), and any algorithm evaluating / can be 
converted into an algorithm describing / G C{X,Y). More precisely: 
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Proposition 3.2.3 Let X,X' be computable metric spaces and Y be an enu- 
merative lattice: 

Evaluation: The function Eval : C(X, Y) x X — > Y is constructive, 

Curryfication: If a function f : X' x X — > Y is constructive then the function 
from X' to C(X, Y) mapping x' G X' to f(x', .) is constructive. 

Lemma 3.2.1 and proposition 3.2.2 implie: 

Corollary 3.2.1 The x- constructive elements ofY are exactly the images of 
x by total constructive functions from X to Y. 

This is a particular property of the enumerative lattice structure: a partial con- 
structive function from some represented space to another cannot in general 
be extended to a total constructive one. 



3. 3 The Open Subsets of a computable metric space 

Following [14], [15], we define constructivity notions on the open subsets of 
a computable metric space. The topology r induced by the metric has the 
numbered set B of ideal balls as a countable basis: any open set can then be 
described as a countable union of ideal balls. Actually (r, C, B) is an enumer- 
ative space (cf section 3), the supremum operator being union. The canonical 
representation on enumerative lattices (definition 3.1.2) induces constructivity 
notions on r, a constructive open set being called a recursively enumerable 
(r.e) open set. 

On the integers, it may be unnatural to show that some subset is recursively 
enumerable, and the equivalent notion of semi-decidable set is often used. 
This notion can be extended to subsets of a computable metric space, and it 
happens to be very useful in the applications. We recall from section 3 that 
{_L, T} is an enumerative lattice, which induces canonically the enumerative 
lattice C(X,{±,T}). 

Definition 3.3.1 A subset A of X is said to be semi-decidable if its indi- 
cator function 1a '■ X — > {_L, T} (mapping x G A to T and x A to _L) is 
constructive. 

In other words, A is semi-decidable if there is a recursive function ip such that 
for all x £ X and all description ~? of x, </?' s l stops if and only if x G A. It is 
a well-known result (see [15]) that the two notions are effectively equivalent: 

Proposition 3.3.1 A subset of X is semi-decidable if and only if it is a r.e 
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open set. Moreover, the enumerative lattices (t,C.,B) and C(X, {_L, T}) are 
constructively isomorphic. 

The isomorphism is the function U i— > 1^ and its inverse / i— > / _1 (T). In 
other words, / _1 (T) is /-r.e uniformly in / and ljj is [/-lower semi-computable 
uniformly in U. It implies in particular that: 

Corollary 3.3.1 The intersection (U, V) h-> U(~)V and union (U,V) ^ UUV 
are constructive functions from r x t to t. 

For computable functions between computable metric spaces, we have the 
following useful characterization: 

Proposition 3.3.2 Let (X, dx, Sx) and (Y, dy, Sy) be computable metric spaces. 
A function f : X — > Y is computable on D C X if and only if the preim- 
ages of ideal balls are uniformly r.e open (in D) sets. That is, for all i, 
f^ 1 (B i ) = UiH D where Ui is a r.e open set uniformly in i. 

We will use the following notion: 

Definition 3.3.2 A U^-set is a set of the form f] n U n where (U n ) n is a se- 
quence of uniformly r.e open sets. 



4 Computing with probability measures 

4-1 Measures as points of the computable metric space A4(X) 

Here, following [5], we define computable measures in the following way: first 
the space M.(X) is endowed with a computable metric space structure com- 
patible with the weak topology and then computable measures are defined as 
the constructive points. 

Given a metric space (X, d), the set JA(X) of Borel probability measures over 
X can be endowed with the weak topology, which is the finest topology for 
which fj, n — > /i if and only if / fdji n — > / fdfi for all continuous bounded 
function / : X — > R. This topology is metrizable and when X is separable 
and complete, JA(X) is also separable and complete (see [16]). Moreover, a 
computable metric structure on X induces in a canonical way a computable 
metric structure on M(X). 

Let T> C M.{X) be the set of those probability measures that are concen- 
trated in finitely many points of S and assign rational values to them. It 
can be shown that this is a dense subset ([16]). The numberings v s of ideal 
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points of X and uq of the rationals numbers induce a numbering v-d of ideal 
measures: P{{ ni ,...,n k ),{mi,...,m k )) is the measure concentrated over the finite set 
{s ni , . . . ,s n J where q mt is the weight of s nv 

4-1.1 The Prokhorov metric 

Let us consider the particular metric on M.(X): 

Definition 4.1.1 The Prokhorov metric p on M.{X) is defined by: 

p(p, v) := inf{e G R + : p(A) < v{A e ) + e for every Borel set A}. (1) 
where A e = {x : d(x, A) < e}. 

It is known that it is indeed a metric, which induces the weak topology on 
M(X) (see [16]). Moreover, we have that: 

Proposition 4.1.1 (A4(X),V, p) is a computable metric space. 

proof: We have to show that the real numbers p(pi,pj) are all computable, 
uniformly in First observe that if U is a r.e open subset of X, Pi(U) is 

lower semi-computable uniformly in i and U . Indeed, if (s ni , q mi ), ■ ■ ■ , (s„ fe , q mk ) 
are the mass points of pi together with their weights (recoverable from i) 
then PiiU) = J2s n .<=u Qmy As the s Uj which belong to U can be enumerated 
from any description of U, this sum is lower-semi-computable. In particular, 
Pi{Bi x U . . . U Bi k ) is lower semi-computable and PiiB^ U . . . U B ik ) is upper 
semi-computable, both of them uniformly in (i, i ± , . . . , i k ) 

Now we prove that p(pi, Pj) is computable uniformly in 

Observe that if pi is an ideal measure concentrated over Si, then (1) becomes 
p(pi, Pj) = inf{e G Q : WA C Si, Pi(A) < Pj(A e ) + e}. Since pj is also an ideal 
measure and A e is a finite union of open ideal balls, the number Pj(A e ) is lower 
semi-computable (uniformly) and then p(pi, Pj) is upper semi-computable, 
uniformly in To see that p(pi, Pj) is lower-semicomputable, uniformly 

in observe that p(pi, Pj) = sup{e G Q : 3A C Si, Pi(A) > Pj(A e ) + e}, 

where A 6 = {x : d(x, A) < e} (a finite union of closed ideal balls when A C Si) 
and use the upper semi-comput ability of pj(A e ). □ 

Definition 4.1.2 A measure p is computable if it is a constructive point 
of{M{X),V,p). 

The effectivization of the space of Borel probability measures A4(X) is of 
theoretical interest, and opens the question: what kind of information can be 
(algorithmically) recovered from a description of a measure as a point of the 
computable metric space M. (X) ? The two most current uses of a measure are 
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to give weights to measurable sets and means to measurable functions. Can 
these quantities be computed ? 

4-1.2 The Wasserstein metric 

In the particular case when the metric space X is bounded, an alternative 
metric can be defined on JA(X). When / is a real- valued function, /if denotes 
Jfdfi. 

Definition 4.1.3 The Wasserstein metric on A4(X) is defined by: 

W( l i,v) = sup {W-vf\) (2) 
fei-Lip(x) 

where 1 — Lip(X) is the space of 1-Lipschitz functions from X to M. 
We recall (see [17]) that W has the following properties: 
Proposition 4.1.2 

(1) W is a distance and if X is separable and complete then M.{X) with this 
distance is a separable and complete metric space. 

(2) The topology induced by W is the weak topology and thus W is equivalent 
to the Prokhorov metric. 

Moreover, if (X,S,d) is a computable metric space (and X bounded), then: 

Proposition 4.1.3 (A4(X),V,W) is a computable metric space. 

proof: We have to show that the distance W(/ii,iij) between ideal measures 
is uniformly computable. From we can compute the set Sij = supp(/j,i)U 
supp(fij). Let so £ Si j, then we can suppose that the supremum in (2) is 
taken over 1 - Lip° So (X) := {/ e 1 - Lip(X) : 1 - Lip° So (X) f (s) = 0}. Given 
some precision e we construct a finite set M e C \ — Lip° So (X) made of uniformly 
computable functions such that for each / G 1 — Lip° So (X) there is some / G Af e 
satisfying sup{|/(x) — l(x)\ : x G Sij} < e: compute an integer m such that 
Sij C B(s,m)] then |/| < m for every / G 1 — Lip Q s (X). Let n be such that 
m/n < 2e. For each s G S iy j and a G {^f }HL_ m let us consider the functions 
defined by 4>t,i{ x ) '■= a + d(s,x) and (f>Ji(x) := a — d(s,x). Then it is not 
difficult to see that M e defined as the set of all possible combinations of max 
and min made with the (f)^f(x) satisfy the required condition. 

Therefore, since sup(|/ — g\) < e implies \/i(f — g)\ < e we have that: 

G [sup(|^-/i^|),sup(|/i^-/i^|) + 2e] 

geAf c geAf c 
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where the fag are computable, uniformly in %. The result follows. □ 

When X is bounded, the effectivisation using the Prokhorov or the Wasserstein 
metrics turn out to be equivalent. 

Theorem 4.1.1 The Prokhorov and the Wasserstein metrics are computably 
equivalent. That is, the identity function id : (A4(X),T>, p) — > (JA(X), V, W) 
is a computable isomorphism, as well as its inverse. 

proof: Let M be an integer such that sup x j, 6 _y d(x, y) < M. Suppose p(p, u) < 
e/(M + 1). Then, by the coupling theorem [16], for every /el — Lip(X) it 
holds \pf — vf \ < e, then W(p, v) < e. Conversely, suppose W(p, v) < e 2 < 1. 
Let A be a Borel set and define gf := \l — d(x, A)/e\ + . Then egf G 1 — Lip(X). 
W(p, v) < e 2 implies pegf < uegf+e 2 and since p,(A) < p,gf and ugf < i'(A t ), 
we conclude fi(A) < v(A e ) + e and then p(/i, v) < e. Therefore, given a fast 
sequence of ideal measures converging to [i in the Prokhorov metric, we can 
construct a fast sequence of ideal measures converging to p, in the W metric 
and vice-versa. □ 

This equivalence offers an alternative method to prove computability of mea- 
sures. It is used for example in [18] to show the computability of the physical 
measures for some classes of dynamical systems. 

4-2 Measures as valuations 

We now investigate the first problem: can the measure of sets be computed 
from the Cauchy description of a measure? Actually, the answer is positive 
for a very small part of the Borel sigma-field. It is a well-known fact that a 
Borel (probability) measure p, is characterized by the measure of open sets, 
which generate the Borel sigma-field. That is, by the valuation v M : r — > [0, 1] 
which maps an open set to its /z-measure. The question is then so study this 
characterization from a computability viewpoint. 

The first result is that the measure of open sets can be lower semi-computed, 
using the Cauchy description of the measure. 

Proposition 4.2.1 The valuation operator v : A4(X) x r — > [0,1] mapping 
(p, U) to p(U) is lower semi- computable. 

proof: as t> M = v (p, .) is Scott-continuous (see remark 3.1.1), it suffices to 
show that it is uniformly lower semi-computable on finite unions of balls. 

We first restrict to ideal measures pc we have already seen (proof of proposi- 
tion 4.1.1) that all Pi{Bi x U . . . UB ik ) are lower semi-computable real numbers, 
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uniformly in . . . , ik). 



Now let (/i/e n )ngN a description of a measure \i, that is a fast sequence converg- 
ing to /i for the Prokhorov distance: then p(/ife n ,/x) < e n where e„ = 2 _n+1 . 
For n > 1, and C/ = B(s h , g^J U . . . U B(s ik ,qj k ) define: 

m<k 

note that x C C/ n and L^ n C [/. We show that /i(£/) = sup n (/ij n (?7 n ) - e n ): 

• H„(U n ) < fJ.(U) + e n for all n, so //([/) > sup n (/i Jn (C/ n ) - e„). 

• /x([/ n _i) < fij n (U n ) + e n for all n. As C/„_i increases towards ?7 as n — > oo, 
fi(U) = sup n (//(C/ n _i) - 2e n ) < sup n (// jn (C/ n ) - e n ). 

As the quantity Hj n (U n ) — e n is lower semi-computable uniformly in n, we are 
done (observe that everything is uniform in the finite description of U). □ 

The second result is stronger: the lower semi-computability of the measure of 
the r.e open sets even characterizes the computability of the measure. 

Theorem 4.2.1 Given a measure fi G M.(X), the following are equivalent: 

(1) fi is computable, 

(2) '. t — > [0, 1] is lower-semi-computable, 

(3) ^(B^ U . . . U B ik ) is lower- semi- computable uniformly in (ii, . . . 
proof: 

[1 =>- 2] Direct from proposition 4.2.1. [2 =>- 3] Trivial. [3 =^ 1] We show that 
p(/i„,/i) is upper semi-computable uniformly in n, and then use proposition 
2.4.2. Since p(/i„,/i) < e iff fi n (A) < fi(A t ) + e for all A C S n where S n is the 
finite support of /i„, and fi{A e ) is lower semi-computable (A e is a finite union 
of open ideal balls) p(/i„,/i) < e is semi-decidable, uniformly in n and e. This 
allows to construct a fast sequence of ideal measures converging to /i. □ 

It means that a representation which would be "tailor-made" to make the val- 
uation constructive, describing a measure [i by the set of integers (ii, . . . , ik, j) 
satisfying fi^B^ U . . . U B ik ) > qj, would be constructively equivalent to the 
Cauchy representation. This is the approach taken in [3] for the special case 
X = [0, 1] and in [4] on an arbitrary sequential topological space. In both case, 
the topology on Ai(X) induced by this representation is proved to be equiva- 
lent to the weak topology. A domain theoretical approach was also developed 
in [2] on a compact space, the Scott topology being proved to induce the weak 
topology. 
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4-2.1 The examples of the Cantor space and the unit interval. 



On the Cantor space S N (where £ is a finite alphabet) with its natural com- 
putable metric space structure, the ideal balls are the cylinders. As a finite 
union of cylinders can always be expressed as a disjoint (and finite) union of 
cylinders, and the complement of a cylinder is a finite union of cylinders, we 
have: 

Corollary 4.2.1 A measure /i G .M(£ N ) is computable iff the measures of 
the cylinders are uniformly computable. 

On the unit real interval, ideals balls are open rational intervals. Again, a 
finite union of such intervals can always be expressed as a disjoint (and finite) 
union of open rational intervals. Then: 

Corollary 4.2.2 A measure \i G .M([0, 1]) is computable iff the measures of 
the rational open intervals are uniformly lower-semi-computable. 

If fi has no atoms, a rational open interval is the complement of at most 
two disjoint open rational intervals, up to a null set. In this case, fi is then 
computable iff the measures of the rational intervals are uniformly computable. 

4-3 Measures as integrals 

We now answer the second question: is the integral of functions computable 
from the description of a measure ? 

The computable metric space structure of X and the enumerative lattice struc- 
ture of R induce in a canonical way the enumerative space C(X,W ) (see 
section 3.2), which is actually the set of lower semi-continuous functions from 
X to 1 + . We have: 

Proposition 4.3.1 The integral operator J : M(X) x C(X, R + ) — ► M + is 
lower semi- computable. 

proof: the integral of a finite supremum of step functions can be expressed 
by induction on the number of functions: first, / f^d/i = qj/i(Bi) and 



where q jm is minimal among {q h , . . . , q jk } and q fi = q h - q jm ,qf 2 = q h - 
qj m ,etc. Note that f{i m j' m ) being the zero function can be removed. 
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Now, m can be computed and by proposition 4.2.1 the measure of finite unions 
of ideal balls can be uniformly /x- lower semi-computed, so the integral above 
can be uniformly //-lower semi-computed. For any fixed measure //, the in- 
tegral operator / dji : C(X, M + ) — > 1R + is Scott-continuous, so it is lower 
semi-computable. □ 

Again, the lower semi-computability of the integral of lower semi-computable 
functions characterizes the computability of the measure: 

Corollary 4.3.1 Given a measure /i G M.{X), the following are equivalent: 

(1) fi is computable, 

(2) J d/i : C(X, R + ) — > R + is lower semi- computable, 

(3) J supj/jj, . . . , fi k }dfi is lower-semi-computable uniformly in (ii, . . . , i^) ■ 
proof: 

[2 3] holds by Scott-continuity of the operator, 
[1 =>- 2] is a direct consequence of proposition 4.3.1, 

[2 =>- 1] is a direct consequence of theorem 4.2.1, composing the integral opera- 
tor with the function from r to C(X, R + ) mapping an open set to its indicator 
function (which is computable, see proposition 3.3.1). □ 

It means that a representation of measures which would be "tailor-made" to 
make the integration constructive, describing a measure by the set of integers 
(ii, . . . ,i k ,j) satisfying f sup{f h , . . . , f ik }d/i > q, h would be constructively 
equivalent to the Cauchy representation. 

A corollary of proposition 4.3.1 will be used in the last section: let be 
a sequence of uniformly computable functions, i.e. such that the function 
(i,x) I— > fi(x) is computable. If moreover has a bound Mj computable 
uniformly in i, then the function (/i, i) — * / fad/i is computable. Indeed, 
fi + Mi (resp. Mi — /j) is uniformly lower (resp. upper) semi-computable, 
so / focly = f(fi + Mi)dn - Mi = Mi - f(Mi - fydfj, and proposition 4.3.1 
allow to conclude. 



5 Computable Probability Spaces 

The representation induced by the binary numeral system of real numbers is 
generally presented as not adequate for computability purposes since simple 
functions as x \— > 3a; are not computable with respect to it. This lies in the 
fact that the real interval and the space of sequences are not homeomorphic. 
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On the other hand, if we are insterested in probabilistic issues, the binary 
representation is actually suitable, and may even be preferred: almost every 
real has a unique binary expansion. 

More generally, computability notions from computable analysis are effec- 
tive versions of topological ones (semi-decidable sets are open, computable 
functions are continuous, etc). What about effective versions of measure- 
theoretical/probabilistic notions? 

In this section we study a computable version of probability spaces, that is, 
metric spaces equipped with a fixed computable Borel probability measure. 
This will give us a framework allowing to talk about almost everywhere com- 
putability or decidability notions. Let us then introduce: 

Definition 5.0.1 A computable probability space is a pair where 
X is a computable metric space and ji a computable Borel probability measure 
on X . 

Definition 5.0.2 A morphism of computable probability spaces F : 

— > (y, v), is a computable measure-preserving junction F : Dp C X — > 
Y where D F is a (full-measure) U^-set. 

An isomorphism (F,G) : ^ (y,v) is a pair (F,G) of morphisms 

such that G o F = id on F~ 1 (D G ) and F o G = id on G~ 1 (D F ). 

We recall that F is measure-preserving if v(A) = fi(F^ 1 (A)) for all Borel set 
A. 



5.1 Generalized binary representations 

The Cantor space 2 W (2 denotes {0, 1}) is a privileged place for computability. 
This can be understood by the fact that it is the countable product (with the 
product topology) of a finite space (with the discrete topology). A consequence 
of this is that membership of a basic open set (cylinder) boils down to a 
pattern-matching and is then decidable. As decidable sets must be clopen, this 
property cannot hold in connected spaces. As a result, a computable metric 
space is not in general constructively homeomorphic to the Cantor space. 

Nevertheless, the real unit interval [0, 1] is not so far away from the Cantor 
space. The binary numeral system provides a correspondence between real 
numbers and binary sequences, which is certainly not homeomorphic, unless 
we remove the small set of dyadic numbers. In particular, the remaining set 
is totally disconnected, and the dyadic intervals form a basis of clopen sets. 
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Actually, this correspondence makes the computable probability space [0, 1] 
with the Lebesgue measure isomorphic to the Cantor space with the uniform 
measure. This fact has been implicitly used, for instance, to extend algorithmic 
randomness from the Cantor space with the uniform measure to the unit 
interval with the Lebesgue measure. 

We generalize this to any computable probability space, over which we define 
the notion of binary representation. We show that every computable probabil- 
ity space has a binary representation. This implies, in particular, that every 
computable probability space is isomorphic to the Cantor space with a com- 
putable measure. To carry out this generalization, let us briefly scrutinize the 
binary numeral system on the unit interval: 

5 : 2 U — > [0, 1] is a total surjective morphism. Every non-dyadic real has a 
unique expansion, and the inverse of 5, defined on the set D of non-dyadic num- 
bers, is computable. Moreover, D is large both in a topological and measure- 
theoretical sense: it is a residual (a countable intersection of dense open sets) 
and has measure one. (S, <5 _1 ) is then an isomorphism. 

In our generalization, we do not require every binary sequence to be the ex- 
pansion of a point, which would force X to be compact. 

Definition 5.1.1 A binary representation of a computable probability space 
(X, (j,) is a pair (5, fig) where fig is a computable probability measure on 2 W and 
5 : (2 aJ ,/i < 5) — > (X,fi) is a surjective morphism such that, calling 5~ 1 (x) the set 
of expansions of x £ X : 

• there is a dense full-measure U^-set D of points having a unique expansion, 

• 5~ l : D — > 5~ l (D) is computable. 

Remark that when the support of the measure (the smallest closed set of full 
measure) is the whole space X, like the Lebesgue measure on the interval, 
a full- measure LT^-set is always a residual, but in general it is only dense on 
the support of the measure: that is the reason why we explicitly require D to 
be dense. Also remark that a binary representation 5 always induces an iso- 
morphism (5, <5 _1 ) between the Cantor space and the computable probability 
space. 

The sequel of this section is devoted to the proof of the following result: 

Theorem 5.1.1 Every computable probability space (X,fi) has a binary rep- 
resentation. 

The space, restricted to the domain D of the isomorphism, is then totally 
disconnected: the preimages of the cylinders form a basis of clopen and even 
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decidable sets. In the whole space, they are not decidable any more. Instead, 
they are almost decidable. 

Definition 5.1.2 A set A is said to be almost decidable if there are two 
r.e open sets U and V such that: 

U C A, V C A c , U U V is dense and has measure one 

Definition 5.1.3 A measurable set A is said to be /x-continuous or a fi- 

continuity set if fi(dA) = where dA = Af] X \A is the boundary of A. 

Remark that, as for subsets of N, a set is almost decidable if and only if its 
complement is a.s. decidable. An almost decidable set is always a continuity 
set. Let B(s,r) be a yU-continuous ball with computable radius: in general it is 
not an almost decidable set (for instance, isolated points may be at distance 
exactly r from s). But if there is no ideal point is at distance r from s, then 
B(s,r) is almost decidable: take U = B(s,r) and V — X \ B(s,r). 

We say that the elements of a sequence (Aj) ie pj are uniformly a.s. decidable if 
there are two sequences (Ui)^ and (Vi)^ of uniformly r.e sets satisfying the 
conditions above. 

Lemma 5.1.1 There is a sequence (r n )„ eN of uniformly computable reals such 
that (B(si,r n ))(i tn ) is a basis of uniformly almost decidable balls. 

proof: define U^k) = {r G 1 + : fi(B(.Si,r)) < ^(B(s, h r)) + 1/k}: by com- 
putability of fi, this is a r.e open subset of R + , uniformly in (i, k). It is further- 
more dense in IR + : the spheres S r = B(si,r) \ B(si,r) form a partition of the 
space when r varies in R + and /i is finite, so the set of r for which fu,(S r ) > 1/k 
is finite. 

Define V{ij) = R + \ {d(si, Sj)}: this is a dense r.e open set, uniformly in 

Then by the computable Baire Category Theorem (see [19], [20]), the dense U®- 
se t f](i,k) U(i t k)^f](i,j) contains a sequence (r n ) nG N of uniformly computable 
real numbers which is dense in M + . In other words, all r n are computable, 
uniformly in n. By construction, for any Sj and r n , B(si, r n ) is almost decidable. 

We recall that from an enumeration {I n ) n eH of all the rational compact inter- 
vals of IR + , r n is constructed computing a nested shrinking sequence (J^)fc e pj 
of rational compact intervals starting from Jq = J„, and such that J% +1 C 
J%nU k nV k . Then {r n } = a 4 n - □ 

We will denote B(si,r n ) by B% where k = (i,n). Note that different algorith- 
mic descriptions of the same [i may yield different sequences (r n ) ne fq, so B^ 
is an abusive notation. It is understood that some algorithmic description of 
fi has been chosen and fixed. This can be done only because the measure \i 
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is computable, which is then a crucial hypothesis. We denote X \B(si,r n ) by 
and define: 

Definition 5.1.4 Form G 2*, the cell T(w) is defined by induction on \w\: 



r(e) = X, T(wO) = T(w) n Cf and r(iwl) = r(iu) n 5f 
where e is the empty word and i = \w\. 

This an almost decidable set, uniformly in w. 



proof: (of theorem 5.1.1). We construct an encoding function b : D — > 2 W , a 
decoding function <5 : -D^ — > X, and show that 5 is a binary representation, 
with b = S -1 . 

Encoding. 

Let D — fli -Bf UCf : this is a dense full-measure n^-set. Define the computable 
function b : D -> 2 W by: 



6(x) i 



l ifxeSf 
ifxeCf 



Let x G D: uo = b(x) is also characterized by {x} = H? r(^o..i-i)- Let be 
the image measure of /x by 6: /15 = // o 6 _1 . 6 is then a morphism from (X, /i) 
to(2-,/i 5 ). 

Decoding. 

Let L>5 be the set of binary sequences u such that f|j ^(^o..i-i) is a singleton. 
We define the decoding function 5 : D$ — > X by: 

(JH=xif f|rK.i-i) = W 



is called an expansion of x. Remark that s G Bf => Wj = 1 and a; G Cf =>- 
= 0, which implies in particular that if x G D, x has a unique expansion, 
which is b(x). Hence, 6 = : <J _1 (D) -> D and /J,s(D s ) = //(£>) = 1. 

We now show that 5 : — > X is a surjective morphism. For seek of clarity, 
the center and the radius of the ball B% will be denoted s$ and 7^ respectively. 
Let us call i an n-witness for if < 2~( n+1 \ uji = 1 and r(cj ..i) 7^ 0- 

• Ds is a Ilg-set: we show that D$ = flnl^ e2":w has a n-witness}. 
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Let uj G Ds and x = S(u). For each n, x G B(si, r,) for some i with < 2 _(n+1 ). 
Since x G r(o>o..j), we have that r(w ..i) 7^ and o>i = 1 (otherwise r(cj . j) is 
disjoint of Bf). In other words, i is an n-witness for uj. 

Conversely, if uj has a n-witness i n for all n, since r(cj ..j„) ^ -B^ whose 
radius tends to zero, the nested sequence (T(uio..i n ))n of closed cells has, by 
completeness of the space, a non-empty intersection, which is a singleton. 

• 5 : Ds — > X is computable. For each n, find some n-witness i n of a;: the 
sequence (s in ) n is a fast sequence converging to 5(u>). 

• 5 is surjective: we show that each point x G X has at least one expansion. 
To do this, we construct by induction a sequence uj = uj uj\ . . . such that 
for all i, x G T(uo ■ ■ - uJi). Let % > and suppose that Wo • • • (empty 
when % — 0) has been constructed. As £?f U Cf is open dense and r(co>o..i-i) is 
open, r(cj ..i-i) = r(o;o..j_i) fl (B-f U Cf) which equals r(a;o..i_iO)ur(a;o..i_il). 
Hence, one choice for Ui G {0, 1} gives x G r(o; ..j). 

By construction, x G Hi F(o;o..j-i)- As (-Bf)« is a basis and u>i = \ whenever 
x G .Bf , uj is an expansion of x. □ 



5.5 Another characterization of the computability of measures 

The existence of a basis of almost decidable sets also leads to another char- 
acterization of the computability of measures, which is reminiscent of what 
happens on the Cantor space (see corollary 4.2.1). Let us say that two bases 
(Ui)i and (Vi)i of the topology r are constructively equivalent if both id T : 
(r, Q,U) — > (r, C, V) and its inverse are constructive functions between enu- 
merative lattices. 

Corollary 5.2.1 A measure /j, G M.(X) is computable if and only if there 
is a basis U = (Ui) ie ^ of uniformly almost decidable open sets which is con- 
structively equivalent to B and such that all ^(U^ U . . . U UjJ are computable 
uniformly in (ii, . . . , ik). 

proof: if fi is computable, the a.s. decidable balls Uu n \ = B{s,^r n ) are basis 
which is constructively equivalent to B: indeed, B(si,r n ) = \J q:j<rn B(si,qj) 
and B(si,qj) = \J rn < qj B(si,r n ), and r n is computable uniformly in n. 

For the converse, the valuation function / M is lower semi-computable. Indeed, 
the r.e open sets are uniformly r.e relatively to the basis U, so their mea- 
sures can be lower-semi-computed, computing the measures of finite unions of 
elements of U. Hence \x is computable by theorem 4.2.1. □ 
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6 Algorithmic randomness 



On the Cantor space with a computable measure /i, Martin-L6f originally 
defined the notion of an individual random sequence as a sequence passing 
all /i-randomness tests. A /i-randomness test a la Martin-Ldf is a sequence of 
uniformly r.e open sets (U n ) n satisfying /i(U n ) < 2~ n . The set f] n U n has null 
measure, in an effective way: it is then called an effective null set. 

Equivalently, a /i-randomness test can be defined as a positive lower semi- 
computable function t : 2 W — > R satisfying / tdfi < 1 (see [21] for instance). 
The associated effective null set is {x : t(x) = +00} = C\ n {x : t(x) > 2 n }. 
Actually, every effective null set can be put in this form for some t. A point 
is then called /i-random if it lies in no effective null set. 

Following Gacs, we will use the second presentation of randomness tests which 
is more suitable to express uniformity. 

6.1 Randomness w.r.t any probability measure 

Definition 6.1.1 Given a measure \x G M(X), a ^-randomness test is 

a /i- constructive element t of C(X, R + ) ; such that J td/i < 1. Any subset of 
{x G X : t(x) = +00} is called a ^-effective null set. 

A uniform randomness test is a constructive function T from A4(X) to 
C{X,R + ) such that for all fi G M{x), JT^dfi < 1 where denotes T(/i). 

Note that T can be also seen as a lower-semi-computable function from M. (X) x 
X to R + (see section 3.2). 

A presentation d la Martin-Ldf can be directly obtained using the constructive 
functions F : C(X,R + ) -> r N and G : r N -> C(X,R + ) defined by: F(t) n : = 
t^ 1 (2 n , +00) and G((U n ) n )(x) := sup{n : x G rij<ri Ui}. They satisfy F o G = 
id : r N — > r N and preserve the corresponding effective null sets. 

A uniform randomness test T induces a /i-randomness test for all /i. We 
show two important results which hold on any computable metric space: 

• the two notions are actually equivalent (theorem 6.1.1), 

• there is a universal uniform randomness test (theorem 6.1.2). 

The second result was already obtained by Gacs, but only on spaces which 
have recognizable Boolean inclusions, which is an additional computability 
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property on the basis of ideal balls. 

By proposition 3.2.2, constructive functions from A4(X) to C(X, 1R + ) can be 
identified to constructive elements of the enumerative lattice C(A4(X),C(X, R )). 
Let (Hi) ieN be an enumeration of all its constructive elements (proposition 
3.1.1): Hi = sup fc ftp(i,k) where <p : N 2 — > N is some recursive function and the 
f n are step functions. 

Lemma 6.1.1 There is a constructive function T:Mx M(X) — > C(X, M + ) 
satisfying: 

• for all i, Ti = T(i, .) is a uniform randomness test, 

• if f Hi(/j,)dfM < 1 for some /i, then T^/i) = i?j(/z). 

proof: To enumerate only tests, we would like to be able to semi-decide 
/ sup fc<n / ¥ ,(j ) fc)(/i)d// < 1. But sup fe<n f<p(i,k) (/-0 is ° m y lower semi-computable 
(from /i). To overcome this problem, we use another class of basic function. 

Let y be a computable metric space: for an ideal point s of Y and positive 
rationals q, r, e, define the hat function: 

h q , s ,r,e(y) '■= V-i 1 - [%> s ) - r] + /e} + 

where [a] + = max{0,a}. This is a continuous function whose value is q in 
B(s, r), outside B(s, r+e). The numberings of S and Q >0 induce a numbering 
(h n )ne¥i of all the hat functions. They can be taken as an alternative to step 
functions in the enumerative lattice C(Y, R ): they yield the same computable 
structure. Indeed, step functions can be constructively expressed as suprema 
of such functions: /^j) = sup{h Qj S ^_ e e : < e < r} where Bi = B(s,r), and 
conversely. 

We apply this to Y — Ai(X)xX endowed with the canonical computable met- 
ric structure. By Curryfication it provides functions h n G C(A4(X), C(X, 
with which the Hi can be expressed: there is a recursive function tp : N 2 — > N 
such that for all i, Hi = sup fc h^ k y 

Furthermore, h n (/i) (strictly speaking, Eval(h n , fj), see proposition 3.2.3) is 
bounded by a constant computable from n and independent of //. Hence, the 
integration operator / : M(X) x N — > [0,1] which maps (//, . . . , i^)) to 
/ supj/ijj (//), . . . , hi k (fi)}dfi is computable. 

We are now able to define T: T(i,/i) = sup{iff(/x) : / i?f(/x)d/x < 1} where 
iff = sup n<fe h^ n y As / Hi(fj,)d/i can be computed from i, and a description 
of /i, T is a constructive function from N x .M(X) to C(X, R + ). □ 
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As a consequence, every randomness test for a particular measure can be 
extended to a uniform test: 

Theorem 6.1.1 (Uniformity vs non-uniformity) Let /i be a measure. For 
every ^-randomness test t there is a uniform randomness test T : A4(X) — > 
C{X,W + ) with T(/i ) = \t. 

proof: let /io be a measure and t a /i -randomness test: \t is then a /io- 
constructive element of the enumerative lattice C(X, M + ), so by lemma 3.2.1 
there is a constructive element if of C(A4(X), C(X, R )) such that H(fi ) = 
|t There is some i such that H = Hf. T { is & uniform randomness test satis- 
fying Tj(yU ) = |t because / Hi(fx )dfi — \ J tdfi < 1. □ 

Theorem 6.1.2 (Universal uniform test) There is a universal uniform ran- 
domness test, that is a uniform test T u such that for every uniform test T there 
is a constant ct with T u > ctT . 

proof: it is defined by T u := J2i 2" l_1 Tj: as every Tj is a uniform randomness 
test, T u is also a uniform randomness test, and if T is a uniform impossibility 
test, then in particular |T is a constructive element of C(A4(X), C(X, 
so \T = Hi for some i. As / H^fj^dfx = \ JT(fx)dfj, < 1 for all /x, Tj(/i) = 
Hi(fi) = \T{n) for all /i, that is % = \T. So T u > 2~ i - 2 T. □ 

Definition 6.1.2 Given a measure fi, a point x e X is called p-random if 
T£(x) < oo. Equivalently, x is \i-random if it lies in no p,- effective null set. 

The set of /i-random points is denoted by R^. This is the complement of the 
maximal /z-effective null set {x e X : T^(x) = +oo}. 



^.^ Randomness on a computable probability space 

We study the particular case of a computable measure. As a morphism of 
computable probability spaces is compatible with measures and computability 
structures, it shall be compatible with algorithmic randomness. Indeed: 

Proposition 6.2.1 Morphisms of computable probability spaces are defined 
on random points and preserve randomness. 

To prove it, we shall use the following lemma: 

Lemma 6.2.1 In a computable probability space (X,fi), every random point 
lies in every r.e open set of full measure. 



26 



proof: let U = \J^^ eE B(si,qj) be a r.e open set of measure one, with E a 
r.e subset of N. Let F be the r.e set {(i, k) : 3j, G E,q k < qj}. Define: 

U n = |J B(si,q k ) and V? = \J B( Si ,q k ) 

[i,k)<=Fn[0,n] (i,k)eFn[0,n] 



Then U n and V n are r.e uniformly in n, U n /* U and U c = f] n V n . As fJ.(U n ) 
is lower semi-computable uniformly in n, a sequence (ni)^ can be computed 
such that fi(U ni ) > 1 -2~\ Then n(V ni ) < 2~\ and U c = f]i V ni is a /i-Martin- 
Lof test. Therefore, every /i-random point is in U. □ 

proof: (of proposition 6.2.1) let F : D C X — > Y be a morphism. From lemma 
6.2.1, every random point is in D which is an intersection of full-measure r.e 
open sets. 

Let t : Y — > R + be the universal u-test. The function t o F : D — > R + is 
lower semi-computable. Let ^4 be any algorithm lower semi-computing it: the 
associated lower semi-computable function : X — * M + extends to F to the 
whole space X (see lemma 3.2.1). As /jl(D) — 1, J t o Fd[i is well defined and 
equals / fj^d^x. As F is measure-preserving, / toFd/i = J tdu < 1. Hence is 
a //-test. Let x G X be a /i-random point: as rr G D, t(F(x)) = /a( x ) < +°o, 
so F(x) is //-random. □ 

Corollary 6.2.1 Let (F,G) : (X,(J>) ^ (3^,^) an isomorphism of com- 
putable probability spaces. Then F\ R and G\ R are total computable bijections 
between and R v , and (F| fl ^) _1 = G\ Rv . 

In particular: 

Corollary 6.2.2 Let 5 be a binary representation on a computable probability 
space Each point having a fis-random expansion is ji-random and each 

ji-random point has a unique expansion, which is jis-random. 

This proves that algorithmic randomness over a computable probability space 
could have been defined encoding points into binary sequences using a binary 
representation: this would have led to the same notion of randomness. Using 
this principle, a notion of Kolmogorov complexity characterizing Martin-L6f 
randomness comes for free. For x G D, define: 

H n (x) = if(w ..n-i) and F n (x) = <J([w ..n-i]) 
where u is the expansion of x and H is the prefix Kolmogorov complexity. 

Corollary 6.2.3 Let 5 be a binary representation on a computable probability 
space (X, ji). Then x is fi-random if and only if there is c such that for all n: 

H n (x) > - log/t(r n (x)) - c 
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All this allows to treat algorithmic randomness within probability theory over 
general metric spaces. In [22] for instance, it is applied to show that in ergodic 
systems over metric spaces, algorithmically random points are well-behaved: 
they are typical with respect to any ergodic endomorphism of computable 
probability space, generalizing what has been proved in [23] for the Cantor 
space. 
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